New algorithm for learning decomposable models
نویسنده
چکیده
There exist a lot of algorithms for the construction of Bayesian Networks (BN). But almost all computations in BN are carried out by transforming them to another special type of probabilistic models decomposable models (DM). This task of transformation is known to be a NP complex problem and todays algorithms for the construction of BN cannot guarantee the existence of reasonably small DM (it is necessary to fit this DM to the memory of computer). So why not to construct directly DMs? Advantages and disadvantages of the construction of BNs and DMs are discussed. A new algorithm for construction of DMs using tests of independence is presented. It is based on the recursive identification of a simplicial vertex (SV) and its boundary (which forms a clique of DM and enables removing of this vertex). This identification of simplicial vertices is based on definition of the SV and a heuristic approach for finding boundary to a given vertex, which is asymptotically correct. This algorithm needs moreover a heuristic approach how to select a vertex to be simplicial if no such vertex is identified from the definition. A comparison of quality (evaluated as Kullback-Leibler I-divergency) of BNs constructed by program BNPC and DMs constructed by the new algorithm for different sizes of learning data is shown.
منابع مشابه
Algorithms for Learning Decomposable Models and Chordal Graphs
Decomposable dependency models and their graphical counterparts, i.e., chordal graphs, possess a number of interesting and useful properties. On the basis of two character izations of decomposable models in terms of independence relationships, we develop an exact algorithm for recovering the chordal graphical representation of any given decom posable model. We also propose an algorithm for le...
متن کاملLearning Decomposable Models for Classification
In some situations graphical models are learned to be used for classification of one given variable. The standard learning algorithms usually do not take this background knowledge into account. In the case of Bayesian networks this knowledge is often incorporated by assuming that the target variable will have no parents. This leads to discovering potentially bigger Markov boundaries of the targ...
متن کاملStructure Learning with Nonparametric Decomposable Models
We present a novel approach to structure learning for graphical models. By using nonparametric estimates to model clique densities in decomposable models, both discrete and continuous distributions can be handled in a unified framework. Also, consistency of the underlying probabilistic model is guaranteed. Model selection is based on predictive assessment, with efficient algorithms that allow f...
متن کاملContext Speciic Interaction Models
Interaction models for categorical data play a central role in applied statistics. In particular, decomposable models have obtained a dominant position as the basis for structural learning and the development of eecient computational algorithms in connection with Bayesian networks for decision support. The present paper generalizes decompos-able models to cover log linear models, where interact...
متن کاملConstructing vertex decomposable graphs
Recently, some techniques such as adding whiskers and attaching graphs to vertices of a given graph, have been proposed for constructing a new vertex decomposable graph. In this paper, we present a new method for constructing vertex decomposable graphs. Then we use this construction to generalize the result due to Cook and Nagel.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2000